Bloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.
At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.
Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.
We are looking for skilled Senior Data Engineers to join our team if you have a strong background in software development and a passion for data science. You will work with us on building technologies and tools to ensure the correctness of our search datasets, to protect our clients' personally identifiable information, and to enable key stakeholders to derive insights for the purposes of informing their decisions on the future development of Bloomberg's Search products.
Join the AI Group as a Senior Data Engineer and you will have the opportunity to:
• Develop and maintain a productionized logging system that produces verifiably correct datasets to support both online Business Intelligence applications as well as offline ML Model training and evaluation pipelines.
• Implement reusable, efficient, maintainable, and testable code that works on different platforms and scales to billions of data points for the purposes of sessionization, ingestion, and metrics computation.
• Work with application and product teams to define data needs and SLAs, then implement a data model using idiomatic schema designs tailored to the dataset's intended use case.
• Design and implement metrics measuring various aspects of the Bloomberg search experience and create Business Intelligence dashboards to help subject matter experts continuously monitor quality, extract actionable insights, and identify new feature development opportunities.
We are looking for a Senior Data Engineer with:
• 4+ years of experience working with Python and at least one other object-oriented programming language (C/C++, Java, etc.).
• A degree in Computer Science, Engineering, Mathematics, or similar field of study or equivalent work experience.
• An understanding of Computer Science fundamentals such as data structures and algorithms and a data oriented approach to problem-solving.
• Excellent communication skills and the ability to collaborate with engineering peers as well as non-engineering stakeholders.
• A proven track record building ETL pipelines leveraging technologies such as Kafka Streams, Kafka Connect, Flink, or Spark Streaming.
• Prior experience building or extending data lakes, using various storage, cataloging, and retrieval technologies such as S3, HDFS, Hadoop, HBase, Hive, Trino, Presto, Cassandra, Spark.
• Familiarity with workflow orchestration technology, such as Argo, Airflow, or Oozie.
